Three wheeler auto-rickshaws are fastest and most convenient. You need to fix the price before you start - you will find these all around the town.
If you plan to visit the temples, you can bargain a package deal - cost depends on how many and which temples you might want to visit. A thumb rule of price is around rs.20 between point to point.